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LECTURES  ON  DIFFERENTIAL  GAME,  f 
L  KRTERYAGIN 


Lecture  J.  .  -I 

-  ^EPSr.--  7iVJ 

We  are  going  to  talk  about  the  problem  of  the  pursuit  of  one 
controlled  object  by  another  controlled  object.  The  most  important 
feature  of  the  problem  lies  in  the  fact  that  the  future  behavior  of 
the  object  being  pursued  Is  not  assmed  to  be  known.  In  realizing 
the  pursuit  we  must  start  from  information  concerning  the  state  of 
the  objects  at  a  given  time  and  the  knowledge  of  the  technical 
potentialities  of  these  objects. 

Here  we  denote  the  state  of  an  object  by  x  and  assume  that 'the 
controlled  motions  of  the  object  can  be  described  by  the  ordinary 
differential  equation 


(1) 


x  =  f(x,u) 


D  D 


^ere  u  is  the  control  parameter. 

//)L1_  i 

X  consists  of  two  parts:  UUmW^rrjT,  If 

=  geometrical  position 

V 

Xg  =  velocity. 

Equation  (1)  gives  the  potentiality  of  the  object  by  describing 

all  possible  motions  of  ^ich  the  object  is  capable.  In  order  to  give 

the  concrete  motion  of  the  object,  we  have  to  specify  its  initial  state 

X  at  some  moment  t  und  then  prescribe  the  values  of  the  control  u 
o  o 

as  a  function  of  time. 
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SrcuHt^  dlaasiftralioo 


In  a  p\irsuit  problem  one  considers  tvo  objects  x  and  yj  the 
potentiality  of  the  second  object  is  described  by  the  differentiaJ. 
e  iuation 

(2)  *  y  =  6(y,v)  . 

Similar  to  (l),  here  v  is  a  control  parameter  and  y  consists  of 
tvo  parts  y  =  (y,  ,y„),  irtiere  y,  denotes  the  geometrical  position 

±  JL 

and  y^  denotes  the  velocity  of  the  second  object. 

We  assume  that  y  moves  in  an  arbitrary  manner  in  accordance 
•with  (2)  and  -that  x  aims  to  catch  up  with  it  in  as  short  a  time  as 
possible,  using  all  its  technical  capabilities,  •that  is  moving  according 
to  (1),  5Che  pursuit  is  considered  to  be  con^Jleted  at  •the  ins^tant  \dien 
X  and  y  coincide  geometrically  (i.e.,  3^  «  y^). 

5he  problem  is:  if  at  eac).  ins^tant  of  time  one  knows  the  s^tates 
x(t),  y(t)  and  v(t),  "to  prescribe  the  •value  u(t)  so  "that  •the  pursuit 
Is  realized  in  the  best  way, 

u  =  u(x,y,v)  . 

Ibere  is  a  different  viewpoint  •to  the  problem:  •the  problem  of 
evasion,  where  v(t)  is  chosen  in  order  •to  avoid  ending  "the  game, 

V  =  v(x,y,u)  . 

How  we  refoimulate  -these  two  problems,  -the  pursuit  problem  and 
the  evasion  problem,  as  follows: 


T 


Define  z  =  (x,y),  durect  sum  of  x  ard  y.  •  We  call  z  the 
state  of  the  game  z  =  F(z,u,v)  is  the  comtir.ation  of  (l)  and  (2). 

The  game  ends  when  z  hits  the  subspace  M  =  tz  e  Rjx^  =  y^^) 
of  the  phase  si)ace  R. 

The  problem  of  pursuit  is  to  find 


u  =  u(z,v)  In  order  to  end  the  game. 


The  problem  of  evasion  is  to  find 


V  =  v(z,u)  in  order  to  prolong  the  game. 


^  a  Veiy  many  papers  on  the  pursuit  problem  have  been  published, 
but  not  on  the  evasion  problem.  I  will  consider  the  evasion  problem 
in  the  next  lecture.  Now  I  will  only  talk  about  the  general  formulation 
of  the  problems. 

In  order  to  obtain  some  concrete  reults,  we  will  restrict  our¬ 
selves  to  linear  problems,  ihe  differential  equation  of  the  linear 
.differential  game  is  written  as  follows: 


z  =  cz  -  u+  V  , 


where  c  is  the  n  x  n  matrix,  u  €  p,  v  e  Q,  and  P,  Q  are  convex 
and  compact  subsets  of  R.  M  is  defined  as  before  and  let  L  be  the 
subspace  of  R  orthogonal  to  M;  L  J.  M  and  R  =  L@K. 
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If  A  L  and  B  ^  L,  we  say  that  A  is  smaller  than  B  iff  3  a 
vector  a  such  that  a  +  A  "  B  , 


By  Jt  we  denote  the  operator  of  orthogonal  projection  onto  L. 

1C  is  obviously  a  linear  transformation.  Let  us  consider  the  linear 
Tc 

nap  n  e  ,  wiiere  T  is  any  positive  number,  and  define 

u  e  ^  Q  • 

In  order  to  get  a  positive  solution  to  the  pursuit  gEone ,  the 
control  parameter  u  has  to  have  certain  “superiority"  over  v. 
Similarly,  in  order  to  prolong  the  game  indefinitely,  v  has  to  have 
■  certain  "superiority"  over  u. 

Proposition  1.  Assme  there  exists  t  >0,  such  that 
-  o  ' 

dim(P^)  =  dim(L)  =  v  and  P.^.  for  0  <  t  <  Then  there  is 

a  positive  solution  to  the  pursuit  game  in  the  sense  that  there  ir  a 
subspace  ft  with  the  property  that  if  e  ft,  there  is  a  finite 
t(z^)  such  that  the  game  ends  before  t  =  t(z^). 
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Proposition  2.  Assume  there  exist  M  >  1  such  that 

^(Q^)  =  dim(L)  =  V  >  2  and  for  re  (0,t^).  nien  for 

each  Zjj  /  M  BvaVti  Z(t)  ^  M;  in  other  words,  the  game  never  ends. 


If  the  conditions  in  Proposition  2  are  satisfied,  2(t)  can  be 
very  close  to  M.  Ve  want  to  estimate  the  distance  between  z(t) 
and  K. 

Define 

l(t)  =  distance  between  s{t)  and  M 


and 


=  |»(^(t))|  ■ 

nCt)  =  distance  between  2(t)  and  L 


¥e  have,  under  certain  conditions. 


t(t)  > 


csNo) 

[1  +  ti(t)]® 


i*ere  k  and  a  are  integers  and  c,  k,  and  m  all  depend  on  the 
gpme  itself. 


Finally  I  want  to  point  out  that  however  complete  the  information 
ctmceming  the  state  of  the  sev^ond  object  at  a  given  instant  of  time 
may  be,  it  is  necessary  to  speed  some  finite  amount  of  time  in  calculating 
and  evaluating  this  information,  therefore  the  above  formulation  is 
not  realistic.  The  way  out  of  this  difficulty  is  as  follows:  we  can 
make  the  pursuit,  not  of  y  itself,  but  of  the  position  in  -vdiich  it 
was  found  a  short  time  beforehand.  Thus  u(t)  is  chosen  as  a  function 
of  x(t),  y(t-A)  and  v(t-A),  ipdiere  A  is  a  small  positive  number. 
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Lecture  2 

Review:  Consider  the  linear  differential  game 

(l)  3  =  cz  -  u  +  V 

z  €  R  Euclidean  space 
c:  R  -♦  R 


u  €  p 
V  €  Q 


convex,  compact  siibsets  of  R 


dim  P  and  dim  Q.  <  dim  R 

M 

L  XK 
R  =  1, 0M 

Projection  x:  R  -*  L 


Let  us  consider  the  following 
Example: 

Question:  If  1)  E  is  a  vector  spcce,  dim  E  =  v  >  2, 

2)  X  ^  y  €  E  are  the  gecanetrical  positions  c.f  the  pursuer  and  the 
evader,  5)  x  ^  y  satisfy 


(2) 

X  +  ax  =  a  , 

|a|  <  P  > 

(3) 

y  +  Py  =  b 

|bj  <  a  , 
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vhere  a  ar  i  b  are  controi  vectors  and  Ot,p,p,cr  >0,  4)  the  game 

ends  vhen  x  =  y,  then  what  are  the  conditions  for  the  pursuit  problem 
and  the  evasion  problem  to  have  a  positive  solution? 


Answer;  If  p  .>  a,  the  pursuit  control  has  sup;  riority  over 
the  evasion  control;  then  the  pursuit  game  has  a  positive  soliition. 

On  the  other  hand^  if  p  <  ct,  the  pursuit  control  has  inferiority 
over  the  evasion  control;  then  the  evasion  game  has  a  positive  solution. 


yroof ;  (x,x)  is  the  phase  vector  of  x 
(y>y)  is  the  phase  vector  of  y 
(x,x,y,y)  is  the  phase  vector  of  the  game. 

Bie -'state  Afariables  (x,x,y,y)  can  be  reduced  as  follows.  Let 


then 

and 

and 


and 


i-  1  2  5\ 
z  «  (z  ,z  ,z^) 

e  E  ,  i  =  1,2,5, 

R  =  {(z^,z^,z^))  , 

2  =  (x-y)  =  X-  y  =  z  -  z 

z~  =  X  =  -  otx  +  a  =  -otz^  +  a 
z^  =  -pz^  +  b 

u  =  (C,-a,0) 

=  (0,0,b)  . 


Y 


Hence 


P  =  {(0,-a,0),  [aj  <  p) 

Q  =  {(C,0,b),  jbl  <  a) 

M  =  (z|?.^  =  0}  =  {(0,z^,z^))  V  z^,  z^  f  E 
L  =  V  z^  €  E 

4z^,z^,z5)  =  (r>,0,0)  ^  z^ 


c  = 


0  -a 

0  0 


-1 

0 

-P 


In  order  to  ccenpnte  jc  e 
>different3al  equation 


tc 


i  *6  «  f 


z  -  cz 


.12  5 

.2  „  2 

z  =  -  Cz 

z^  =  -  pz^  , 


Iherefoie, 


I  -a  I  ,  ve  solve  the  following  homogeneous 
\0  / 


z5(t)  .  z’ 


2,.^  -at  2 

z  (t)  =  e  z^ 


•l/*\  -at  2  -pt  5 
z  (t)  =  e  z  -  e  ^  z^ 


l,^^  1  1- e"®^^  2  1-e"^^  5 

^  =  ^o  ^  —a—  ^o  '  “p—  *o 


tc  n  1-  e 

e  =  (1,  — - 


-at 


1-  e 


»  I 


i>vasi- 


/ 
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^flierefore 

-OT 

Px  =  —  pi 

Qx  =  My|  < —  ‘^i  * 


¥or  T  «1  , 


Px  =  { jx|  <  Tp  +  •••) 

Qx  =  ( |yl  <  'To  +  *••)  . 

Therefore  if  p  >  a,  P^  >  then  3  a  solution  to  pursuit  problem, 

fbad^df  0  >  p,  3  p  >  1  apP-f^  Q^>  then  3  a  solution  to  evasion  problem. 


Review: 


E  =  Euclidean  vector  space 
ciijn(E)  =  V  >  2 


x,y  e  I 


X  +ax  =  a  ,  ja}  < 

y  +  Py  =  b  ,  jb!  < 


positive  niaabers 


2^  =  x-y 
2 

2  =  X 


R  =-  (z  =  (2^,Z^,Z^)) 

M  =  {(0,2''',Z^))  =  {(z^,z^)3 
L  =  {(z^,0,0))  =  {z^) 


L  =  F 


~  ^  l^i  £  ^ 

^  ^  ***^ 


Let  us  consider  the  I'olloving  two  cases. 

1)  a>p  ,  then  the  evasion  control  has  superiority  over  pursuit 

> 

J 


control . 


8  > 


If  jx(0)-y(0)|  >  e  ana  y(t)j  >  e  for  all  t,  then 

Nt)  -y(t)j  >  7£^. 

If  |x(0)-y(0)j  >  £  and  |x{t)- y{t)j  =  e  for  some  t,  then, 

2 

by  the  above  resvilt,  ve  have  jx(t)-  y(t)  >  ye  .  Hence  we  get  the 
following  two  cases 

(1)  If  jx(0)-y(0)|  >  e,  then  jx(t)-y(t)}  >  . 

(?)  If  lx(0)- y(0)j  <  £,  then  lx(t)- y(t)j  >  7H0)- y(0)l-®. 

In  either  case  the  g&me  may  last  forever. 


2)  p  >  o  .  Let  tis  consider  ^  and  ^  .  As  shown  above,  £ 
<iax^cterizes  the  range  of  the  velocity  of  the  pursuer,  and  ~ 
characterizes  the  range  of  the  velocity  of  the  evader.  iSiereforc, 


£<£ 
a  P 


the  game  nsay  lei.t  forever. 


£>£ 
Of  p 


the  game  may  he  ended. 


My  next  lecture  will  he  devoted  to  the  evasion  problem. 

In  order  to  show  Low  and  are  ccaqpared  to  judge  whether 
the  game  may  last  forever  or  may  he  ended,  we  solve  the  following 


equation 


J  z  =  cz  + 
^z(O)  =  z^ 


v(t)  -  u(t) 


end  look  at  «z(t).  Ibe  solution  to  the  corresponding  homogeneous 
eq’.iatioa  z  =  cz  is  z(t)  =  e^^c  .  Let  the  solution  to  (♦) 
z(t)  =  e^*^  c(t),  then 
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e‘'“c  =  v(t)  -  u(t) 

c  =  e"'‘^‘^(v(t)  -  u(t)) 

c(t}  =  4  /  '!"®'^(v(s)  -  u(s))ds 

z(t)  =  z  +  /  e‘^“(v(s)  -  u(s)ds 

°  o 

=  ^  v(t-T)-  u(t-T))dT 

o 

*z(t)  =  It  z  +  J  (x  e'^  v(t.-T)-  a  e  u(t-T))di 
°  o 

*  e*^-  v(t  T)  € 

X  U(1  -t)  e  . 


t 

» 

i 

I 

f 

\ 

i 

i 


Ik 


Lecture  4 

Tc 

Consider  the  linear  transformation  «  e  :  R  -»  L.  Let  us  denote 


it  by 


Each  of  the  elements  is  an  analytic  function  of  T  for  small  T.  It 
Is  veil  knovn  that  is  "equivalent”  to  a  matrix  GCt)  ,  in  the 

sense  that 


(2)  g^  =  A('i)G(T)B(T)  , 

..  •  :> 

vhere 


and  |A(0)j  /  0;  1b(o)|  /  0  (A,  B  nonsingular  for  smali.  t),  vhere 

|a(o)|  =  detA(0).  Lex. 

C(T)  =  A~^(T) 

D(T)  =  b’^(t)  , 


then 


15 
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By  repeated  application  of  the  precedlig  ohaarvations  and  similar 
ones  about  pre-multiplication,  ve  see  ‘.hat  can  be  transformed 


Consider  the  operation 


?  K 


0  1  Ih  0 


0  4 


0  1 


0 


0 


^  4 


^  tc 

=  T  (a  +  bT  +  . . . )  . 


Let  'll  =  l/a  +  bT  +  . . .  . 

Therefore,  the  above  claim  is  proved; 


=  A(t)g(t)b(t) 


Let  y  =  A(t)x,  then  p  <  <  q,  vhere  p  and  q  are  two  positive 


constants . 


Tbeoreffl.  L't  P  =  {all  polynomials  f(a,p)jin  two  variables 

such  that  deg  f  =  m,  with  at  least  one  of 
'  the  coefficients  equal  to  +1  or  -1}  , 
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A  =  ((«,P)  1  P  1  ' 

and 

A(6)  =  a  square  with  dimension  6. 

5hen  E  6  >  0  and  cr  >  0  3  for  all  f  €  P  thei’e  exists  A(&) 

(depending  on  f )  such  that 

jf(a,p)j  >  <r  ,  v(a,p)  e  a(&)  ,  and  V  f(a,p)  e  p  . 


Proof;  Consider  the  conqjact  subset  Q  ^  P  defined  by 
Q  =  {f(a,^)  €  pjthe  absolute  value  of  every  coefficient  <  1)  . 

V  -  if 

It  can  easily  be  shown  that  the  conclusion  is  true  for  P  replaced 
by  Q.  Bien  consider  arbitrary  f(o,&)  €  P-  Q  .  Let 

a  =  maximum  of  the  absolute  values  of  the  coefficients  .of  l(OE,fj), 


Dlls  completes  the  proof. 


Corollc.ry-  Let  =  {f(a,p)jat  least  *3ne  of  the  coeffif.ients  is 

-fa  or  -  a,  deg  1  =  n) . 

‘Bien  3  j  >  0  and  a  >  0  a  for  all  f  e  P  there  exists  A(S)  such 
that 

|f(a,^)!  >  aar  ,  V(a,3)  e  A(a)  ,  ani  Vf{a,p)  £  P^  • 
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Lecture  5 


^dieorem.  Consider  tvo  polynomials 


x(t)  =  a  -j  a^t  -»•  +  •  •  •  +  +  oct^ 

y(t)  =  b  +  +  b^t^  +  •  •  •  +  b^t^  + 


Suppose 


|a.  j  <K  ,  +  «i  <  K 

\\\  <K  ,  h/  +  <  K  , 


vhere  K  is  a  positive  number.  'Ihen  there  exists  &  >  0  such  that 


V(«>P)  €  Ajffi)  end  t  €  [0,1]  - 

Remark.  (x(t),y(t)),  t  €  [0,1]  defines  a  curve  in  the  (x,y)-plane 

|x(t)|  +  ly(t)l  is  an  estimate 
of  the  distance  between  the  point 
y(t))  and  the  origin  (0,0) 


Proof.  Let  us  denote  the  discriminant  of  the  two  polynomials 


X  and  y  by 


=  «(o,P)  • 
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From  algebra  we  know  that  if  =  0,  (x,y)  passes  through  (C,0), 

if  A  /  0,  (x,y)  does  not  pass  (0,0).  We  now  compute 

Multiplying  the  first  polynomial  by  l,t,t^, . .  .,t^'~^  and 

2  k-1 

multiplying  the  second  polynomial  by  l,t^t  ,...,t  ,  we  have* 


a  +  a^t  +  •  •  •  +  aj^t^  +  OEt^+  + 


_  . k+i-1 

■  •  +  0*t  SS  X 


0  +  at  +  aj^t^  +  ...  +  +  0Ct^'*‘^+  ...  +  O-t^*"^"^  =  xt 


A  .  .  A  .  .  .  ..  uX+i-l  _.k+i-l  ^i-1 

0  +  •••  +  0  +  at  +  •  4 »  + 


b+b-tv  ••♦+  b.t^  +  pt^  +  •••  +  ■*"  ss  y 

t  •i*'  i  ^ 


L'^l  .  fix'll 


k+f-1 


0+bt  +  ...  +  b,t^‘  +  pt^  +  ...  +  0.t''^  *  =  yt 


0+  ...  +  0+bt^"^  +  ...  +  =  yt^“^  . 


We  consider  the  above  equations  as  a  system  of  simultaneous  algebraic 

2  k+jf-1 

equations  for  the  variables  l,t,t  , . . .  ,t  .  Frtao  elementary  algebra 


ve  see  that 


1 


where  s  is  the  coefficient  matrix  and  ^  ±s  ^  with  the  first  colinm 
replaced  by  (x,xt,, . .,xt^"^,  y,yt,...,yt^”^). 


y 
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a(a,p)  =  aV  +  •*• 

i®l 

fi(a,p)  e  p”  . 

Il-I 

Using  the  lemtia  ve  mentioned  in  the  last  lecture,  ve  obtain 


U(a,P)|  >  ala|^  , 

if 

if 

(a,p)  €  a  certain  square  A*(b) 

I 

(«,P)  €  a  certain  square  A"(&) 


Bence 


if  (a,p)  e  a(B)  , 


vhere  a(6)  =  A*(&)  or  A"(B)  according  to  Aether  jaj^  >  jb|^ 
or  |a|'^  <  |tj^.  'ihen  ve  have 


- 7-^ — 

Since  jt|  <1,  ve  have  jxt^j  <  jx  I.  |yt^l  <  |yl  .  On  the  other 
hand,  any  minor  of  order  k+i-1  of  £  is  bounded  by 

(k+f-l)!K^'^^'^  , 

then 

2  <  (ijxj  +  k|yl)(k4i-l):K^'^^"^ 


which  implies 

2<7(|.:1  t  |y|)K**'‘ 


Consequent! y , 

x|  +  jy|  > 


lor  some  constant  C  >  0  as  desired. 
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Here  ve  only  consider  the  case  where  Is  a  square  v  X  v 

matrix 

»  A(t)g(t)b(t),  det  A(0)  /  0  ,  det  b(0)  f  0 


A  simple  calculation  yields 

I  A('r)G(T)dT  =  A(t)G(t)  , 
o 

>aiere  det  A(0)  /  0  and 


Consider  a  vector  <f(t)  with  components  q)^  satisfying  jip^j  <  c"", 
c  ^  0.  Again  a  simple  calculation  yields 

/  A('r)G{T)q)(T:)dT  =  A(t)G(t)9(t)  , 
o 

where  j9.(t)j  <  ct,  if  0  <  t  <  p,  p  >  0,  where  p  depends  only  on 

A(T). 
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Kov  let  VIS  cont5jnue  the  discussion  of  the  differential  game. 

We  assume  z(t  )  is  very  near  to  M.  Our  purpose  is  to  prevent 
c 

titc  ending  of  the  game  in  the  time  interval  [t^,t^].  Let  us  assvime, 
without  loss  of  generality,  t^  =  0  and  t^^  =  fe. 

We  nov  rewrite  the  equation  of  the  game  as 

£  =  cz  +  V*  '  i! *  ,  u*  €  p*  and  v*  e  Q*, 

in  order  to  save  the  notations  v  and  u  for  later  use. 

Recall  that  a  condition  for  the  evasion  problem  to  have  a  solution 
is  that  dim(jr  e*^^  Q')  =  v.  We  make  this  assumption  here.  Hence, 

'  V*  ^ 

dia(Q‘)  >  V  . 

We  will  consider  only  the  case  dlm(Q*)  =  v  to  illustrate  the  idea 
of  proof. 

Obviously,  3  affine  subspace  u'  such  that  P*  U*  , 

dim  P*  =  dim  U'.  55ien  3  u  €  U'  and  a  linear  subspace  U  ^  L 
-i  o 

U*  =  u^  +  U  . 

If  we  choose  u^  e  Int(p*),  then  p'  =  u^  +  P  and  0  e  P.  Similarly, 

3  affine  subspace  V’  3  Q*  c:  y'  and  3  v^  e  V'  and  a  linear  subspace 

V«=L  3V’=v  +  V  and  Q*  =  v  +  Q. 

o  o 

Define 


f^(u)  =  Jt  e^*^  u. 

V  U  €  U 

&j(v)  =  }{  e”^*^  V , 

V  V  e  V 

1  J»i! 


p*" 
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Notice  that  g^  is  non-degenerate  (non-singular)  mapping:  V  ->  L, 
hy  our  assumption 

dlm(Q’)  ■-  V  =  dim{L)  ,  for  T  >  0  , 

Hit  P’  (*  s  e'^'^  Q‘  Mf^(P)  (*  g^-CQ)  • 


Define 


Hence 


*T  “  «t'  » 


h_  = 


T  >  0  . 


Mh^(P)  (*  Q  . 

Notice  that  each  element  of  g^^  can  be  expressed  in  the  form 


bx  + 


vhere  K  may  be  negative.  Itierefore  h^  mi^t  have  a  similar  fonn. 
If  this  is  the  case,  3  u  e  u  3 


-»oo,  asX-»0. 

But  ph^(p)^Q  and  Q  is  comjract,  so  we  obtain  a  contradiction 
and  thus  we  know  that  h^(u)  is  an  Ecialytic  function  of  x  even 
at  X  =  0  and  h^  has  a  definite  limit  at  x  =  0.  Hence  it  is 
pcssibr^e  to  choose  v^  3  Mh^(P)  ^  Q.  But  jih^(P)  c;  Q  =>  h^(p)  ^  ^  ^  ^ 

so  we  can  find  w  e  V  with  components  jv^j  <7,  7  >  0  such  tliat 

-  +  w  c  Q  . 

M 

Hence 

+  w  c  Q  . 


liet  us  assume  we  have  a  pursuit  control.  Consider  the  evasion 


control  v(t)  =  h  ,(u(t))  +  V  . 

First, however,  it  is  necessary  to  do  the  following  computation 

g.r(v(t-T))  -  f^(u(t-T))  =  g^(v(t-T)  -  h^(u(t-T))) 

=  g.t(h^j(u(t-T))+W-h^(u(t-T))) 

=  g^^Cw-  (h^.~h^)(u(t-T))) 

=  A('r)G{T)B(T)(w-  (h^-h^)(u(t-T))) 

=  A(T)G{'r)(w(T:)+q)(t,T)) 

'■  * t 

/  A(T)G(T)(v{T)+(p(t,T))dT  =  A(t)G(t)(w(t)+$(t))  .  , 

O 

Ibis  will  be  used  in  the  future. 
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where 

“  =  “o  +  “l  ^  “l  =  7(t)  +  ♦(t)  , 

f  (t)  =  a  +  +  . . .  +  . 

Consider  the  mapping  z  -*  where  |  =  |jt(z)l  and  tj  =  jz-jt(z)j. 

In  particular,  z^  -♦  Since  we  assume  z^  very  close  to 

H,  we  have  <  1,  Hence  we  obtain  the  following  inequality  for  the 
coefficients  a .  , 

\\\  <  o(l  +  ^  i  =  0,...,k 

for  - some  p  >  0.  And  analogo'asly  we  get 

|a^(t)l  <  tp(i  +  11^) 

p  >  0,  -the  same  p  as  above.  It  is  necessary  -to  assume 

®o>°* 

o 

If  e  is  small  enou^,  then  0^(t)  sma'.JL  enough.  0  will  be  chosen 

la-ter.  Now  0  is  regarded  as  a  f-lxed  number.  Let  0  =  - . 

°  1  +  Ho 

And  the  coelficient  of  the  last  term  in  the  above  polynomial  of 
X  satisfies 

+  “I  5  p'l  +  %)  • 

How  let  us  introduce  some  new  terminologies, 

,12  vx 

z  =*  (z  ,z  ,...,z  )  . 


z  e  L 


j 
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Hence 
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52 


If  ve  start  outside  (i.e.,  in  S^),  then  as  long  as  we  are  in 
ve  don't  worry.  When  we  reach  the  hypersurface  S  we  turn  on  the 


evasion  control  and  we'  take  this  time  as  the  origin  of  time.  Ihen 

e 


€  S  )  i.e.,  Ijj  ~ 


(1  + 


k  * 


By  inequality  (2)  we  have 


l(t)  > 


c  e 
o 


(1  + 


k^+2k~l 


and  hy  the  same  argument  which  was  used  to  get  (5)> 


1(0  > 


ce 


(1  +  Tl(t)) 

Let  \is  introduce  the  surface  S*:  |  = 


k^+2k-l 


(1  +  n(t)) 


k^+2k-l 


where  S'  and  S'  are  the  exterior  and  the  interior  of  this  surface  S'. 
+ 

.So  durnig  all  the  time  we  apply  this  evasion  control  we  know  that  our 
point  remains  in  S^  ;  ax  the  end  of  th^s  interval  of  time  we  have 
(1)  again  and  so  our  point  is  back  in  S^  ,  and  we  can  do  the  same 
maneuver  again. 

Kow  what  happens  if  z^  c  5_.  Ihen,  during  the  first  interval 
of  time  [0,e]  we  have,  from  (2), 


i(t)  > 


c 

0^0 


C't 


(1  +  t;^)  (1  -<■  Tj(t)) 


55 


Biis  means  that  there  is  no  capture  hetvcen  time  0  and  time  6, 
and  that  at  time  6  we  are  back  in  3^,  and  we  can  act  as  in  the 
first  case . 

Biese  results  are  more  precise  than  the  one  stated  in  the  first 
lecture.  We  can  resume  them  in  the  following  resuD which  is  weaker 
and  true  only  if  ^ 

-k 
c  I 

_ oNd _ 

(1  +  1l(t)) 

But  the  proof  is  not  yet  completed:  there  remains  to  check  that' 
the?fhvaa  of  the  different  intervals  of  time  6  is  infinite,  in  other 
words,  that  we  have  considered  the  problem  for  every  t  >  0. 

e 

e  is  defined  by  6  =  ,  where  6  is  fixed. 

1  +  \ 

If  11  remains  finite-  then  6  is  bounded  from  below  and  the 
o 

series  8  diverges. 

"If  1)^  becomes  infinite,  then  as  ij  isn  at  most  linear  in  0,  the 
series  still  diverges - 

55ie  proof  is  yet  completed. 

Comments .  The  solution  was  based  on  the  maneuver  superiority  of  the 
evader,  but  the  pursuer  can  have  a  speed  superiority.  If  at  the  beginning 
of  the  game  they  stand  very  far  from  each  other,  the  evader  cannot  prevent 
the  distance  to  decrease  and  the  evader  to  pass  very  near  from  him,  but 
tiien  the  distance  will  increase  again. 

It  is  not  clear  why  our  estimates  are  bad  when  i]  is  big.  In  the 
example  where  n  represents  the  velocities,  this  seems  intuitive. 
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The  Pursuit  Problem 

Cteneral  renarks  on  the  non-linear  case 
As  previously,  we  have  a  euclidean  vector  space  R,  and  a 
vector  z,  z  e  R,  whose  motion  is  given  by  z  =  P(z,u,v).  The  game 
is  completed  when  z  e  M  cr  R,  M  is  a  given  set  in  R. 

Rules ;  Three  types  of  rules  can  be  used,  depending  on  the  available 
information  at  time  t  to  choose  u(t). 

1)  The  state  only  is  known:  u  =  u(z). 

2)  The  state  and  the  opponent's  control  are  known:  u  =  u(z,v),  ' 
where  v  =  v(t)- 

3)  The  state  is  known,  as  well  at  the  opponent's  control  history 
for  a  short  interval  of  time  in  the  future:  u  =  u[z,v(s)3, 
where  t<s<t  +  e,  e>0. 

The  third  rule  has  also  a  practical  meaning.  We  shall  use  it  later. 

Questions :  For  any  of  these  three  different  games  there  are  three 
questions  to  answer: 

1)  Starting  from  a  given  z^,  is  it  possible  to  complete  Ihe  game? 

2)  Find  the  time  T(z^)  which  is  sufficient  to  do  so.  This  nviraber 
T  will  be  called  tne  estimating  number,  cr,  regarding  it  as  a 
funetjon  T(z),  the  estimating  function.  It  is  the  interesting 
thing  to  find. 

3)  Is  this  T(z)  the  best  possible  estimating  function? 

If  there  is  no  positive  number  6  such  that  T  -  6  is  also  an 
estirar.cing  number,  then  T  is  said  to  be  optimal.  ' 
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This  optimality  means  that  it  is  possible  to  find  a  control 
hi  stow  v(t)  such  that  the  pursuit  will  iast  a  time  arbitrarily 
close  to  T*  It  must  be  understood  that  this  history  can  depend 
on  everything  else;  u,  the  past  history  of  the  g.-moj  •  •  •  .  If 
there  exists  an  evasion  rule  such  thao  the  process  lasts  exactly 
the  time  T(z^),  then  this  function  is  said  to  be  a  "strong 
optimal"  estiniating  function. 

Thus  we  have  defincvi  three  concepts:  the  estimating  function,  the 
optimal  estimating  function  and  the  strong  optimal.  Thereafter  we  shall 
consider  only  the  first  one. 

Construction  of  the  function  T(z) 

•. .  •  •> 

Given  the  evader’s  control  from  zero  to  c  as 
Y  =  ^(t)  ,  0  t  <  e  , 

Consider  some  control  u(t)  for  the  pursuer. 

We  place  these  control  histories  in  the  differential  equation  of 
the  game; 

z  =  p(z-,  u{t),  v{t))  ,  with  2(0)  =  z^  . 

This  gives  a  solution  which  we  call  z(t)  and,  in  particular,  this 
gives  a  z(e)  =  z^  which  depends  on  the  u(t)  we  have  cbosen. 

Now  consider  the  values  T(Zq)  T(z^  )  of  the  function  T(z). 

The  difference  T(z^)-!r(z^)  depends  on  the  history  u(t).  Among  a.ll 
these  possible  histories,  choose  the  one  that  maximizes  this  difference. 
Call  it  u(x;) 

u(t)  =  arg  raaxfT(z  )-  T(z,  )]  . 

u(.) 
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If  for  this  function  u(t) 

T(Zq)  -  >  e  , 

then  T(z)  is  an  estimr.ting  function.  Tliis  also  gives  the  vay  to 
construct  the  test  possible  u. 

Coament  on  Isaacs'  vork^ 

Iseiacs  assaaes  that  T  is  continuously  differentiable,  and 
that  it  is  a  strong  optimu'n.  Then  letting  e  go  to  zero,  our  relation 
becomes  his  "main  equation".  But  there  are  cases  where  T  does  not 
fulfill  these  conditions. 

.Remark:  In  the  case  where  the  third  rule  is  used  (v  is  known  a- 
time  e  in  the  future),  the  function  T(z)  we  are  looking  .for  jiight 
depend  on  e  .  We  require  that  the  f onction  we  find  be  independent 
of  e  and  hold  for  every  positive  s.  For  the  linear  case  ws  are 
going  to  construct  the  function  T(z)  a  priori.,  without  the  help  of 
an  equation,  and  then  show  that  it  is  an  estimating  function. 


Idnear  case. 

We  consider  now  the  case  where  the  differential  equation  of  the 
game  has  the  form 


z  =  cs-v-u. 


where  v  g  V,  u  e  U.  V  and  U  are  compact  convex  subsets  of  R. 
Completion  is  obtained  when  z  g  M  arbitrary  convex  closed  set. 
^R.  Isaacs:  Differential  Games,  John  Wiley  and  Sons,  1965. 
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We  shall  ncv  const ract  ,  for  positive  t,  a  set  M  such  that  M  ==  M; 

nr  o 

and  is  a  continuous  function  of  t  aiid  considering,  fcr  a  given  z, 
the  expression  e  z ,  we  focus  our  attention  on  the  inclusion  (l); 
verified  or  not 

(l)  e*^  z  €  . 

We  shall  prove  that  T(z)  -  t  ,  where  t  is  l;he  smallest  t  such 

o  o 

that  (l)  is  true. 

Construction  of  M  •  Particular  case:  M  is  a  vectorial  suhsuace. 

-  T  - = - 

As  previous] L  is  the  orthogonal  conplement  of  M,  ir  is  the  orthog¬ 
onal  projection  on  L.  We  shall  construct  a  subset  W^  c  L  and  define 

V .  •  ‘ 

=  {z:  Jtz  €  W^}  with  W^  =  {0} 

so  that  relation  (l)  is  equivalent  to 

xe  ze  W^  . 

•  > 

Definitions ;  Let  us  define  several  concepts  in  set  theory. 

Generalized  addition;  Given  two  convex  subsets  A,B  c  L  and  two 
numbers  a  and  p,  define 

D=aA  +  pB  by  D^{ax  +  py;x£A,yeB}. 

It  is  clear  that  D  is  convex.  If  A  and  B  ai'e  compact,  D  is  ccxnpact. 
Notice  that  for  a  =  p  =  1  we  have  the  classical  sun  and  for  a  =  -p  =  1 
we  have  the  algebraic  difference. 
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Distance  betv:een  two  sets:  Let  H  denote  a  ball  of  center  at 

- r 

zero  and  radius  r: 


H  A  {x:  11x11  <  r) 


and  consider  the  two  inclusions 3  always  verified  for  some  large  enough  r. 


A  c  B  +  H 


B  c  A  +  H  . 
r 


Ke  call  distance  between  the  sets  A  and  3  the  smallest  r  such 
that  these  two  inclaisions  hold- 

^ ' '  -Integral ;  L  being  a  finite  dimensional  euclidean  vector  space, 
and  K  the  set  of  all  compact  subsets  cf  L.  (But  /  K)  K  is  cot 
a  vector  space,  as  no  set  except  from  (0)  seems  to  have  an  additive 
inverse.  It  could  probably  be  imbedded  into  one  by  considering  formal 
differences 


A  -  B, 


A,B  e  K. 


Ihe  fact  that  this  is  a  Banach  space  should  be  checked.  It  is  complete. 
Thus  given  a  continuous  family  A^,  A^  6  K  V  T ,  one  can  define  the 


integral 


E  =  /  A  dr . 

1  T 


Theorem :  It  is  knc..*n  that,  given  any  y  e  E,  there  exists  a 
family  x(t)  such  that  x(t)  «  A^  Vt,  and 


y  =  /  x(t)  It 


Now  if  y  belongs  to  the  boundary  E’  of  E,  then  the  corresponding 
x{t)  belong  to  the  boundary  of  for  almost  all  t  . 

Geometric  subtraction:  Given  A  and  B,  two  subsets  belonging 
to  K,  define 

A  ♦  B  =  D  by  ■  D  A  {x|x  +  B  c  Aj  . 

If  this  set  is  no^.  empty,  tlien  it  is  compact  and  convex-  D  is  a 
function  of  A  and  B,  D(A,B),  but  it  is  not  defined  for  all  A 
and  B-  Notice  that  Ly  its  definition  D  =  A  *  B  is  such  thac 

D  +  B  c  A  . 

Continuity;  The  question  arises  of  laio\ri.ng  if  this  function 
D(A,B)  is  continuous.  The  emswer  is  that  given  A^  and  B^ 

dim(A^  *  B^)  =  dim  L  =  v  , 

then  the  function  D(A,B)  is  continuo\is  at  A^,  B^. 


if 
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(1) 


TC 

ff  e  2  €  V7 

O  T 

and  call  t  the  smallest  t  such  that  it  is  verified.  We  claim 
o 

that  T(z  )  =  t  . 

'  o  o 

Remark:  11*  t  =  0,  this  means  that 
-  o 

JfZ  €  W  -  (O)  . 

o  o 

This  means  that  z  belongs  to  M,  the  game  is  finished,  which  is 

consistent  with  the  result  T(z  )  =  0. 

o 

Proof  of  o\ir  claim:  We  shall  first  consider  the  second  term: 

T  T-  s  T  T  , 

=  /  Sj.dr  =  /  S^dr  +  /  S^dr  =  +  /  S^dr  , 

o  o  T-  e  *"  T-  e 

provided  that  T-e>0. 

Let  us  now  look  at  the  last  integral: 

•i 

S  -  P  *  Q  =  jr  e^  P  *  n  e^  Q 
r  r  —  r  — 

implies,  as  seen  earlier, 

+  JT  Q  c  K  e*'"  P. 

It  is  easy  to  see  that  such  an  inclusion  cai  be  integrated, 

T  T 

/  (S^  +  jt  ii)dr  c  j'  n  e^  P  dr  . 

T-e  T--e 


From  the  definition  of  the  algebraic  sian  it  is  clear  that  the  inclusion 
still  holds  if  one  of  .‘■he  two  sets  on  the  left  side  is  replexied  by  one 
of  its  elements. 

Notice  that  v(t)  is  known  for  0  <  t  <  e  ,  so  that  v(T-r)  is 
known  for  T-e  <  r  <  t  mid  belongs  to  Q.  So  we  can  write 


T  T  T 

(2)  /  S  dr  +  /  jte^v(T-r)dr  cr  /  ite”^Pdr  . 


Let  us  turn  now  to  the  relation  (l),  ne  z  eV  .We  can  write 

o  T 

it  as  follows: 


T  T  T 

v.-i'  +/  ffe^v(T-r)dr  €  W  +J  S  dr  +  /  n v(T-r)dr , 

...  o  T-E  r  \  r  ^ 

T-e  T-e  T-e 


and  making  use  of  (2),  we  have 


+/  ne^  v(T-r)dr  g  W  +  /  ne^Pdr. 

°  J  ~  'T-e  J  o 

T-e  T-e 


•Biis  relation  is  verified  for  t  =  t^  ;  but  it  mi^t  be  true  for  some 
smaller  t.  Let  us  ceQl  Tj^  the  smallest  t  such  that  (3)  is  true. 


ite  :t  e^  v(T^-r)dr  e  W.^  ^  +  /  Ke^''Pdr 


1  Tji^-e 


Frc»B  relation  (3)  it  follows  that  there  exists  a  function  u(Tj^-r)  6  P 
defined  on  the  interval  [0, ej  and  such  that  u{Tj^-r)  €  P,  Vre  fT,-e,T^] 


and  such  that 


r  c  1  X 

^  vi'v^-r)dT  e  _^  +  f  «  e^  u(Tj^-r)dr  . 


1  T^-e 


riMilWIrUTlirl^T 


u(Tj^-r)  is  not  any  element  of  P,  but  it  is  defined  by  this  relation. 
This  last  relation  we  rewrite  as 


i. 

jte  Zq  +  /  ire‘  [v(Tj^-r)  -  u(T^-r)  ]dr  e  , 


and  we  modify  its  left  side  in 


Tj-C 


Then  we  make  the  change  of  variable  of  integration  s  =  r  -  i'c^-e). 
This  same  term  becomes 


(T-,-e)c  e  ^ 

jr  e  {e^z^4  /  e“^f\r(e-s)  - -a(e-s)  jdsj  =Jte 

o 


(T^-e)c 


where  2^  is  by  definition  the  quantity  between  braces.  It  is  clear 
that  2^  is  also  tlo  value  2(e)  of  the  solution  2(t)  of  the  dif¬ 
ferential  equation  of  the  game,  with  initial  value  z(0)  =  z^  and 
applying  the  controls  v(t),  which  was  given,  and  u(t)  that  we  found. 
Our  result  is 


ir  e 


(Tj-e)c 


This  relation  means,  with  our  definition  of  T(z)  , 


T(Zi)  <  . 

Because  is  the  smallest  t  for  which  relation  (3)  holds,  it  is 


possible  to  see  that  actually 
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We  now  check  the  relation  that  a  function  T(z)  must  verify  to  he  an 
estimating  function 

T(2o)-T(z^)  ”  To-Tl  +  E. 
and  because  as  we  have  seen,  ^  > 

T(2^)-T(z^)  >  e. 

So  T(z)  is  an  estimating  function. 

It  can  happen  that  the  difference  will  actually  be  smaller 
than  e . 

•'Remark;  Oar  function  T(z)  is  defined  independently  of  e, 

f 

and  the  result  holds  for  all  e  >  0  . 

It  would  be  intersting  to  find  what  happens  for  e  going  to 
zero.  It  mi^.t  be  possible  to  find  a  u  according  to  the  second 
rule  instead  of  the  third,  namely,  with  the  knowledge  of  current 
state  and  opponent’s  control,  but  not  of  its  control  in  the  future. 
May  be  we  could  find  scanc  bound  on  e.  This  question  is  not  solved 


yet. 


Lecture  11 


Before  giving  an  example  of  use  of  the  previous  theory,  let  us 
make  some  remarks  about  the  geometric  subtraction. 

Remark;  As  previously,  let  be  a  ball  of  radius  r  and 
center  0-  It  is  easily  seen  that 


K  *  !I  =  H 
r  —  s  r-s 


if  s  <  r  . 


Given  a  function  rCt),  real  parameter  T,  it  is  easily  seen  that 


with'/ 


J  K  /  \  dT  =  ILv  /  /  \ 

i  r(T)  r(t) 


t 

f (t)  =  /  r(T)dT 
o 


Example  of  pursiiit  process. 

We  consider  the  example  used  in  the  evasion  process:  In  a 
euclidean  space  E  of  dimension  v  >  2,  a  point  x  (the  pursuer) 
and  a  point  y  (the  evader)  vary  according  to  the  dynamic  possibilities 


X  +  ox  =  a  ||ejj  <  p 

y  +  Py  b  i|bi|  <  a  , 


a,  P,  p  and  (j  are  positive  numbers.  The  game  is  completed  when  x=y 
We  put  this  description  in  the  form  of  a  differential  gajiie,  as  was 
done  earlier,  defining  the  state  z  e  R  , 


1*6 


1  -N 

=  x-y  ^ 

2  .  I  3 

=  X  ✓  ^ 

3  =  y  J 


z  ,  z  and  z^  are  ccmponents  (not  coordinates)  of  z. 


The  subspaces  M  and  L  are  defined  by 


M  =  {(0,z^2^))  ,  L  =  {(z^,0,0)} 


There  is  an  obvious  isomorphism  between  L  and  E,  and  L  v;ill  be 
identified  with  E  thereafter.  The  projection  jt  will  be  considered 
as  a  mapping  of  R  on  E. 

We  have  already  shovm  that 


/  1  2  3x  1 

r(z  ,z  jZ-")  -  z 


The  operator  n  e  ,  first  line  of  the  matrix  e*'",  is 


(z^  €  E,  not  L). 


ir  =  (1  f(t)  -e{t)) 


TC 

^  e  z 


=  n  e  ■‘^(z^,z^,z^)  =  2.^  +  z^  f  (t)  -  t:(T) 


o  o  o  o  o 


=  (x|  !|x!l  <  pf(T)}  ,  =  (x|  llxll  <  crg(T))  , 


where  the  tiro  fivnctions  f(T)  and  e(t)  are 


f(T)  = 


g(T)  = 


Remarks  about  the  functions  f  and  g: 


f(0)  =  g(0)  =  0 

f(T)  =  g(T)  e"^”^ 

f(0)  =  g(0)  =  1  . 

Ks  will  also  need  their  limit  for  t  -»oc. 

lim  f  (t)  =  ^  ,  lim  g(r)  =  ^  . 

T  -400  T  -4CO  ^ 

Geometrical  difference 

"  \(t)  ’ 

wher^  h(T)  =  pf(T)-(rg(T)  • 

Because  the  difference  is  not  defined  for  h(T)  <0,  we  must 
look  at  this  function . 

h(0;  =  0  ,  h(C)  =  p  -  a  >  0  , 

since,  by  assumption,  we  are  in  the  case  v/here  the  pursuer  lias 
maneuvering  superiority  over  the  evader:  p  >  cr 

-ax  -Bt 
h(T;  =  p  e  -  cr 

h(T)  -  0  for  -  —  one  point  at 

cr  - 


and  looking  at  the  limit 
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3i?n 

T  -♦CC' 


h(T\  ^  £ 

a 


£ 


we  d3.stinguish  two  cases, 

^  ^  >  0  :  h(T)  is  always  positive  and  greater  them  some 

Ot  p 

positive  constant  for  t  greater  than  some  positive 
value. 

^  ~  <  0  :  There  exists  a  unique  positive  t  such  that 

s.*  P 

h(T)  =  0  and  h{T)  >  0  for  0  <  t  <  t  • 


Set  W 

-  T 

We  have 

1 

f  Sr  dr  =  a  sphere, 

T 

/  h(r)dr  . 
o 


The  inclusion  jr  e  '  can  now  he  written  as  an  analytical 

expression  since  both  sides  are  known 

\\z^  +  i(T)z^  -  g<T)z^li^  <  h^(T)  , 

and  is  the  smallest  t  for  whicii  this  inequality  holds.  ?y 
continiiity  it  is  clear  that  for  we  shall  have  the  exact  equality 

l|z^  +  f(T  )z^-  g(T  )z^!l  =  h^(T  )  ,  T  >  0  . 

"  o  0^0  ®  o  o  '  o  ^  o 

And  T(z^)  =  Tjj  ,  Tq  being  the  smallest  root  of  the  above  equation^ 


where 


W. 


h(t)  = 


Estimating  function 
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_  t.  .  f  ^  i  ^  ^  ■t  A  •  o  '>  r\y\  ^  ( ^  \ 

i\dijaiiv;  /uijr  ux  uiic  xuuoa  ua  uiix&  c^^ucauxc/h  %*.cj.u.*i%-4>  *■  \*^  i 

which  verifies  Isaacs’  "main  equation"  (Partial  differential  equation). 
But  then  it  has  sever *1  values,  and  insisting  on  choosing  the  lowest 
positive  one  may  leac  to  discontinuities  in  T  and  its  derivatives. 

So  the  hypotheses  on  which  Isaacs*  theory  was  built  do  not  hold 
here.  Moreover,  we  have  an  explicit-  solution  instead  of  a  partial 
differential  equation. 

Let  us  look  at  the  <  ase  where  the  relative  value  of  the  limit 
velocities  is, 

a.  ^ 

Then  hCx)  ^oo,  where  t  -^oo,  so  that,  whatever  be  z^,  there  exists 
a  positive  such  that  the  equality  is  verified.  So  the  game  shall 

always  be  completed,  capture  will  occur  fi .  any  starting  position. 

It  has  been  proved  by  Nikolsky  that  for  a  rather  restrictive  class 
of  games,  containing  this  one,  this  estimating  function  is  also  optimal. 

Remarks :  We  kr.  ow  frcm  the  general  theory  developed  earxier  that 
the  function  T(z)  we  have  canputed  here  is  actually  an  estimating 
function.  We  have  also  given  the  construction  of  the  best  possible  u 
in  the  gev.eral  ceise.  In  this  case  we  can  give  a  di'f'ferent,  but  very 
simple,  construction  of  u  which  ensures  capture  in  exactly  T(z^). 
This  con:.truction  will  not  make  use  of  the  knowledge  of  v  at  a  time 
greater  than  current  time.  But  it  will  also  not  take  advantage  of  the 
possible  "mistakes"  of  the  e-vader. 
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Consider  the  inclusion 

T 

T  C  O 

jte^zef  Sdr 
o  r 

o 

means  that  there  exists  a  measurable  vector  function  s(r)  such  that 

T  c  ‘‘o 

ir  e  °  z  =  /  s(r)(ir  s(r)  £  S  Vr  • 

o 

Kow  the  definition  of  S  is  such  that 

_  rc  -  re  _ 

S^+jte  Qcxe  P, 

vhich  means 

s  (r '  +  n  e^  v  e  it  e^  P,  Vs^eS^,  VveQ, 

so  for  any  given  z^  (=^  given  s(r))  and  any  given  v  there  exists 
a  u  €  P  such  that 

#  %  re  rc 

s(r;  +  Jt  e  V  =  jre  u  . 

If  in  this  equality  we  put  for  v  the  evader's  control  v(t  -r),  then 
It  gives  us  a  pursuit  control  u(T^-r).  Thus  we  have 

E(r)  +  Jt  e”^{v(T^-r)  -  u(T^-r)  ]  =  0  Vr 

and  integrating  from  zero  to  taking  jt  out  of  the  integral, 

T 

T  C  O 

jr(e  °  z  +  /  e^^[v(T  -r)  -  u(t  -r)]dr)  =  0  , 

o  o  o 

o 

which  means  that  2;(t^)  c  M.  Q-E.D. 

Note  that  this  does  not  take  advantage  of  possible  mistakes  of 


the  evader. 


